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Abstract 

The facial reduction algorithm of Borwein and Wolkowicz and the extended dual 
of Ramana provide a strong dual for the conic linear program 

sup { (c, x) | Ax < K b } (P) 

in the absence of any constraint qualification. The facial reduction algorithm solves 
a sequence of auxiliary optimization problems to obtain such a dual. Ramana's dual 
is applicable when j£j is a semidefinite program (SDP) and is an explicit SDP itself. 
Ramana, Tungel, and Wolkowicz showed that these approaches are closely related; 
in particular, they proved the correctness of Ramana's dual using certificates from 
a facial reduction algorithm. 

Here we give a clear and self-contained exposition of facial reduction, of extended 
duals, and generalize Ramana's dual: 

• we state a simple facial reduction algorithm and prove its correctness; and 

• building on this algorithm we construct a family of extended duals when K 
is a nice cone. This class of cones includes the semidefinite cone and other 
important cones. 

Key words: Conic linear programming; minimal cone; semidefinite programming; 
facial reduction; extended duals; nice cones 
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1 Introduction 



Conic linear programs Conic linear programs generalize ordinary linear program- 
ming: they require membership in a closed convex cone in place of the usual nonneg- 
ativity constraint. Conic LPs share some of the duality theory of linear optimization: 
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weak duality always holds in a primal-dual pair, and assuming a suitable constraint 
qualification (CQ), their objective values agree, and are attained. 

When a CQ is lacking and the underlying cone is not polyhedral, pathological phe- 
nomena can occur: nonattainment of the optimal values, positive gaps, and infeasibility 
of the dual even when the primal is bounded. All these pathologies appear in semidefi- 
nite programs, second order cone programs, and p-order conic programs, arguably the 
most important and useful classes of conic LPs ( [3] 131 I3T] HI 1291 171 [HI 12] ). 

Facial reduction and extended duals Here we study two fundamental approaches 
to duality in conic linear programs that work without assuming any CQ. The first 
approach is the facial reduction algorithm (FRA) of Borwein and Wolkowicz [61 [S], 
which constructs a so-called minimal cone of a conic linear system. Using this minimal 
cone one can always ensure strong duality in a primal-dual pair of conic LPs. 

The second approach is Ramana's extended dual for semidefinite programs [25] . 
(Ramana named his dual an Extended Lagrange-Slater Dual, or ELSD dual. We use 
the shorter name for simplicity.) The extended dual is an explicit semidefinite program 
with a fairly large number (but polynomially many) variables and constraints. It has 
the following desirable properties: it is feasible if and only if the primal problem is 
bounded; and when these equivalent statements hold, it has the same value as the 
primal and attains it. Ramana, Tungel and Wolkowicz in [26] showed that the two 
approaches are closely related: in the case of semidefinite programming, the correctness 
of Ramana's dual can be proven using certificates from a facial reduction algorithm. 

The goal of this paper is to give an exposition of these two approaches, study their 
connection, and give simple proofs of generalizations of Ramana's dual. We will use 
ideas from the paper |26] , 




We look at two important questions: 

• How do we use an algorithm to prove the correctness of an explicit conic linear 
program ? 

• Are there other conic LPs with an extended dual? 

Next we present our framework in more detail. A conic linear program can be stated 



where A : X — > Y is a linear map between finite dimensional Euclidean spaces X and Y, 
and c G X, b £ Y. Also, the set K C Y is a closed, convex cone, and we write Ax <k b 
to mean b — Ax G K. We naturally associate a dual program with (jPj) . Letting A* be 
the adjoint operator of A, and K* the dual cone of K, i.e., 




sup (c, x) 
s.t. Ax <k b, 




K* = {y\(y,x)> OVx eK} 
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the dual problem is 

inf {b, y) 

s.t. y > K * (D) 
A*y = c. 

When is feasible, we say that strong duality holds between [F\) and lD\) if the 
following conditions are satisfied: 

• problem is bounded, if and only if §D\ is feasible; and 

• when these equivalent conditions hold, the optimal values of ((£]) and §D\ agree 
and the latter is attained. 

We say that is strictly feasible, or satisfies Slater's condition, if there is an x € X 
such that b — Ax is in the relative interior of K. When is strictly feasible, it is 
well-known that strong duality holds between and (TD|) , 

The facial reduction algorithm (FRA) of Borwein and Wolkowicz constructs a suit- 
able face of K, called the minimal cone of (T!), which we here denote by F m \ n . The 
minimal cone has two important properties: 

• The feasible set of (??) remains the same if we replace its constraint set by 

Ax < F . b. 

• The new constraint set satisfies Slater's condition. 

Thus, if we also replace K* by in (fDj) . strong duality holds in the new primal-dual 
pair. The algorithm in [HJ [5] constructs a decreasing chain of faces starting with K and 
ending with F m \ a , in each step solving a pair of auxiliary conic linear programs. 



Contributions of the paper We first state a simplified FRA and prove its cor- 
rectness. Building on this algorithm, and assuming that cone K is nice, i.e., the set 
K* + F 1 - is closed for all F faces of K we show that the dual of the minimal cone has 
a representation 

^min = { n m + ^+1 : 

(«o,wo) = (0,0) 

(A,b)*( Ui + Vi) = 0,i = l,...,l, 

(ui,Vi) G K* x tan(n H h u^i,K*), i = 1, ...,£+ 1 }, 

where tan(n, K*) denotes the tangent space of the cone K* at u G K* and i is a suitable 
integer. Plugging this expression for F^ in in place of K* in (fl)j) we obtain a dual with 
the properties of Ramana's dual. We show the correctness of several representations of 
-^min' eacri leading to a different extended dual. 
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The cone of positive semidefinite matrices is nice (and also self-dual) , so in this case 
the representation of (jl.ip is valid. In this case we can also translate the tangent space 
constraint into an explicit semidefinite constraint, and recover variants of Ramana's 
dual. 

We attempted to simplify our treatment of the subject as much as possible: as 
background we use only the fact that strong duality holds in a primal-dual pair of conic 
LPs, when the primal is strictly feasible and some elementary facts in convex analysis. 

Literature review Borwein and Wolkowicz originally presented their facial reduction 
algorithm in the two papers [H [5]. Their algorithm works for a potentially nonlinear 
conic system of the form {x\g(x) G K}. Luo, Sturm, and Zhang in [18] studied a 
so-called conic expansion method which finds a sequence of increasing sets starting with 
K* and ending with F^- m : thus their algorithm can be viewed as a dual variant of facial 
reduction. Sturm in |30| introduced an interesting and novel application of facial reduc- 
tion: deriving error bounds for semidefinite systems that lack a strictly feasible solution. 
Luo and Sturm in |17j generalized this approach to mixed semidefinite and second order 
conic systems. Lewis in [16] used facial reduction to derive duality results without a CQ 
assumption in partially finite convex programming. Tungel in [32] constructed an SDP 
instance with n by n semidefinite matrices that requires n — 1 iterations of the facial 
reduction algorithm to find the minimal cone, which is essentially the theoretical worst 
case. 

Waki and Muramatsu in |33j also described an FRA, rigorously showed its equiva- 
lence to the conic expansion approach of Luo et al, and presented computational results 
on semidefinite programs. A preliminary version of this paper appeared in [20]. Polik 
and Terlaky in [25j used the results of [20] to construct strong duals for conic LPs over 
homogeneous cones. Wang et al in [33] presented a facial reduction algorithm for non- 
symmetric semidefinite least squares problems. Cheung et al in [8j developed a relaxed 
version of a facial reduction algorithm, in which one can allow an error in the solution 
of the auxiliary conic LPs, and applied their method to SDPs. 

Nice cones appear in other areas of optimization as well. In [21] we studied the ques- 
tion of when the linear image of a closed convex cone is closed and described necessary 
and sufficient conditions. These lead to a particularly simple and exact characterization 
when the dual of the cone in question is nice. We call a conic linear system well behaved 
if for all objective functions the resulting conic linear program has strong duality with 
its dual and badly behaved, otherwise. In related work, [22], we described character- 
izations of well- and badly behaved conic linear systems. These become particularly 
simple when the underlying cone is nice, and yield combinatorial type characterizations 
for semidefinite and second order conic systems. 

Chua and Tungel in [10] showed that if a cone K is nice, then so is its intersection 
with a linear subspace. Thus, all homogeneous cones are nice, since they arise as the slice 
of a semidefinite cone with a suitable subspace, as proven independently by Chua in [9] 
and by Faybusovich in [11] . In [10] the authors also proved that the preimage of a nice 
cone under a linear map is also nice and in [23] we pointed out that this result implies 
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that the intersection of nice cones is also nice. In [23J we gave several characterizations 
of nice cones and proved that they must be facially exposed; facial exposedness with a 
mild additional condition implies niceness; and conjectured that facially exposed and 
nice cones are actually the same class of cones. However, this conjecture was proven 
false by Roshchina |28j . 

Klep and Schweighofer in [15] derived a strong dual for semidefinite programs that 
also works without assuming any constraint qualification. Their dual resembles Ra- 
mana's dual, but interestingly, it is derived using concepts from algebraic geometry, 
whereas all other references known to us use convex analysis. 

Recently Gouveia et al in |19] studied the following fundamental question: can a 
convex set be represented as the projection of an affine slice of a suitable closed, convex 
cone? They gave necessary and sufncent conditions for such a lift to exist and showed 
that some known lifts from the literature are in the lowest dimension possible. The 
representation of (jl.ip is related in spirit, as we also represent the set F^ in as the 
projection of a conic linear system in a higher dimensional space. 

Organization of the paper and guide to the reader In Section [2] we fix notation, 
review preliminaries, and present two motivating examples. The reader familiar with 
convex analysis can skip the first part of this section and go directly to the examples. 
In Section [3] we present a simple facial reduction algorithm, prove its correctness, and 
show how F^ in can be written as the projection of a nonlinear conic system in a higher 
dimensional space. 

Assuming that K is nice, in Section U] we arrive at the representation in (II. ip . i.e., 
show that F^ in is the projection of a conic linear system, and derive an extended dual for 
conic LPs over nice cones. Here we obtain our first Ramana-type dual for semidefinite 
programs which is an explicit SDP itself, but somewhat different from the dual proposed 
in [25]. 

In Section [5] we describe variants of the representation in (jl.ip . of extended duals, 
and show how we can exactly obtain Ramana's dual. In Section [6] we show that the 
minimal cone F m { n itself also has a representation similar to the representation of F^ in 
in (]l.ip and discuss some open questions. 

The paper is organized to arrive at an explicit Ramana-type dual for SDP as quickly 
as possible. Thus, if a reader is interested in only the derivation of such a dual, it suffices 
for him/her to read only Sections [21 [3] and |H 

2 Preliminaries 

Matrices and vectors We denote operators by capital letters and matrices (when 
they are considered as elements of a Euclidean space and not as operators) and vectors 
by lower case letters. The ith component of vector x is denoted by X{ and the (i,j)th 
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component of matrix z by Z\j. We distinguish vectors and matrices of similar type with 
lower indices, i.e., writing xi, X2, • • • The jth component of vector Xj is denoted by Xij. 
This notation is somewhat ambiguous, as Xi may denote a vector, or the ith component 
of the vector x, but the context will make it clear which one is meant. 

Convex sets For a set C we write clC for its closure, linC for its linear span, and 
C 1 - for the orthogonal complement of its linear span. For a convex set C we denote its 
relative interior by riC. For a one-element set {x} we abbreviate {x}^ by x -1 -. The open 
line-segment between points x\ and x^ is denoted by (xi,X2). 

For a convex set C, and an F, a convex subset of C we say that F is a face of C 
if x\,X2 G C and (xi,X2) H F 7^ implies that x\ and X2 are both in F. For x G C 
there is a unique minimal face of C that contains x, i.e., the face that contains x in 
its relative interior: we denote this face by face(x,C). For x G C we define the set of 
feasible directions and the tangent space at x in C as 

dir(x, C) = { y I x + ty G C for some i > }, 
tan(x,C) = cldir(x,C) n - cldir(x, C). 

Cones We say that a set K is a cone, if Ax G K holds for all x G K and A > 0, and 
define the dual of cone K as 

K* = { z I {z, x) > for all x G A" }. 

For an F face of a closed convex cone if and x G rii* 1 the complementary, or conjugate 
face of F is defined alternatively as (the equivalence is straightforward) 

F A = K* (1F ± = K* (lx ± . 

The complementary face of a face G of K* is defined analogously and denoted by G A . 
A closed convex cone K is facially exposed, i.e., all faces of K arise as the intersection 
of K with a supporting hyperplane iff for all F faces of K we have = F. For 

brevity we write F A * for (F A )* and F A± for (F A ) ± . 

For a closed convex cone K and x G K we have 

tan(x,K) = face(x,if) A± , (2.2) 

as shown in [221 Lemma 1]. 

The semidefinite cone We denote the space of n by n symmetric and the cone of n 
by n symmetric, positive semidefinite matrices by S n , and <S™, respectively. The space 
S n is equipped with the inner product 

n 

X, Z) . — ^ XijZij, 
i,i=l 
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and <S? is self-dual with respect to it. For y € S n we write y y to denote that y is 
positive semidefinite. Using a rotation v T (.)v by a full-rank matrix v any face of <S? 
and its conjugate face can be brought to the form 




xeS r , ,F A = { I |yG5r r , (2.3) 



where r is a nonnegative integer. 

For a face of this form and related sets we use the shorthand 

(::)^(*o)' 

when the size of the partition is clear from the context. The © sign denotes a positive 
semidefinite submatrix and the sign x stands for a submatrix with arbitrary elements. 

For an x positive semidefinite matrix we collect some expressions for tan(x,5") 
below: these play an important role when constructing explicit duals for semidefinite 
programs. The second part of Proposition [1] is based on Lemma 1 in |26| . 

Proposition 1. The following statements hold. 
(1) Suppose x € <S+ is of the form 




and F = face(x, <S™). Then F, F A , and F^ 1 - are as displayed in equation ( f£.^[ ), 
with the upper left block r by r, and 

tan(x,S") = F A± = | " ; | . (2.6) 
(2) For an arbitrary x £ <S™ we have 




tan(x,5") = < w + w 



T 




h for some G R } . (2.7) 



Proof of ([T]) This statement is straightforward from the form of x and the expression 
for the tangent space given in (|2.2p with K = <S?. 



Proof of ([2]) If x is of the form as in equation (|2.5p . then our claim follows from part 

Suppose now that x € 5™ is arbitrary and let q be a matrix of suitably scaled 
eigenvectors of x with eigenvectors corresponding to nonzero eigenvalues coming first. 
Let us write T(x) for the set on the right hand side of equation <\2.7\) . Then one easily 
checks tan(q T xq, <S") = q T tan(a;, <S™)q and T(q T xq) = q T T(x)q, so this case reduces to 
the previous case. ■ 
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Conic LPs An ordinary linear program is clearly a special case of fPl) , If we choose 
X = W n , Y = S n , and K = «S?, then problem (fP"|) becomes a semidefinite program 
(SDP). Since K is self-dual, the dual problem ([Di) is also an SDP. The operator A and 
its adjoint are defined via symmetric matrices ai, . . . , a m as 

m 

Ac = ^XjfZi and A*y = ((oi,y), . . . , {a m ,y)) T . 
i=l 

We use the operator Feas() to denote the feasible set of a conic system. 



The minimal cone Let us choose x G riFeas(P). We define the minimal cone of (??) 
as the unique face of K that contains b — Ax in its relative interior and denote this face 

by -Fmin- 

For an arbitrary y £ Feas(P) there is z € Feas(P) such that x £ (y,z). Hence 
b — Ax E (b — Ay, b — Az), so b — Ay and b — Az are in -F mm , and (??) is equivalent to 

Ax < F ■ b, 

— - 1 min ' 

and this constraint system satisfies Slater's condition. 



Nice cones We say that a closed convex cone K is nice if 



K* + E 1 " is closed for all E faces of K. 



Most cones appearing in the optimization literature, such as polyhedral, semidefinite, 
p-order, in particular second order cones are nice: see e.g. [61 [5l [2Tj . 



Example 1. In the linear inequality system 



(1 





0\ 





-1 


1 





1 











-1 


\o 





1 ) 




< 



M 





W 



(2.8) 



all feasible solutions satisfy the last four inequalities at equality, and for, say, x = 
(—1,0, 0) T the first inequality is strict. So the minimal cone of this system is 

F min = R 1 + x {0} 4 . 

In linear programs strong duality holds even without strict feasibility, so this example 
illustrates only the concept of the minimal cone. 
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Example 2. In the semidefinite program 
sup x% 





(0 


1 


o\ 




f° 





A 




(I 







S.t. X\ 


1 








+ x 2 





1 





\* 
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Vl 





o) 












(2.9) 



a feasible positive semidefinite slack z must have all entries equal to zero, except for zu, 
and there is a feasible slack with z\\ > 0. So the minimal cone and its dual are 










o\ 






x x\ 


F ■ — 

1 mm — 











If*. = 

' mm 


X 


X X 




Vo 











x x y 



(2.10) 



The optimal value of (|2.9p is clearly zero. Writing y for the dual matrix, the dual 
program is equivalent to 



>- 0. 



(2.11) 



inf y n 

( yn 1/2 
s.t. 1/2 y 22 

\-Z/22/2 2/23 

The dual has an unattained minimum: yn can be an arbitarily small positive number, 
at the cost of making y 22 and in turn 7/33 large, however, yn can not be made 0, as y\ 2 
is 1/2. 




Suppose that in (12. lip we replace the constraint y y by y G -F m i n - Then we can 
set yn to zero, so with this modification the dual attains. ■ 

We will return to these examples later to illustrate our facial reduction algorithm 
and extended duals. 

We assume throughout the paper that (??) is feasible. It is possible to remove this 
assumption and modify the facial reduction algorithm of section to either prove the 
infeasibility of (??), or to find the minimal cone in finitely many steps; such an FRA 
was described by Waki and Muramatsu in |33j. 



3 A simple facial reduction algorithm 

We now state a simplified facial reduction algorithm that is applicable when K is an 
arbitrary closed convex cone. We prove its correctness and illustrate it on Examples [T] 
and[2j 

Let us recall that F m i n denotes the minimal cone of §Q) and for brevity define the 
subspace L as 

L = M((A,b)*). (3.12) 
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Lemma 1. Suppose that an F face of K satisfies F m [ n C F. Then the following hold: 
(1) For all y G F* n L we have 



(2) There exists y G F* n L such that the second containment in A3.13\) is strict, iff 
F m in 7^ F. We can find such a y, or prove F = F m i n by solving a pair of auxiliary 
conic linear programs. 

Proof of (pQ) Suppose that x is feasible for (P) and let y G F* n L. Then b — Ax G 
-^min Q F, hence (b — Ax, y) = 0, which implies the first containment; the second is 
obvious. 

Proof of ([2]) The "only if" part of the statement is obvious. To see the "if" part, let 
us fix / G ri F, and consider the primal-dual pair of conic linear programs that we call 
reducing conic LPs below: 



First let us note 

-Fmin = F & 3x s.t. b - Ax G riF 

<^ 3x and t > s.t. b - Ax - ft G F. 

Here in the first equivalence the direction =>■ is obvious from how we defined the minimal 
cone. To see the direction assume b — Ax G ri F. Then ri F n -F m in 7^ an d -Fmin is 
a face of K, so Theorem 18.1 in [27] implies F C F m j IL , and the reverse containment 
already given. The second equivalence is obvious. 

Therefore, F m { n 7^ F iff the optimal value of (R-P) is 0. Note that (R-P) is strictly 
feasible, with some x such that b — Ax G F, and some t < 0. 

Hence F m [ n ^ i 7 iff (R-D) has optimal value and attains it, i.e., iff there is 
y G F* n L with (/, y) = 1. Such a y clearly must satisfy Fflt/ 1 C F. ■ 

Based on Lemma Q] we now state a simple facial reduction algorithm in Figure [TJ 

The algorithm of Figure [T] may not terminate in general, as it allows the choice of 
a yi in iteration i such that F{ = it even allows y% = for all i. Based on this 

general algorithm, however, it will be convenient to construct a representation of -F min . 



Fmin Q F C\y Q F. 



(3.13) 



sup t 
(R-P) s.t. Ax + ft< F b 



inf b*y 

s.t. y > F * (R-D) 
A*y = 

(f,y) = i. 
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Facial Reduction Algorithm 


Initialization: 


Let y = 0, F = K, i = 1. 


repeat 






Choose yi € L n F*_ v 




Let F i = F i _in^ L . 




Let i = i + 1. 


end repeat 





Figure 1: The facial reduction algorithm 



We call an iteration of the FRA reducing, if the vector found therein satisfies 
Fj £ Fj_i; we can make sure that an iteration is reducing, or that we have found the 
minimal cone by solving the pair of conic linear programs (R-P)-(R-D). It is clear that 
after a sufficient number of reducing iterations the algorithm terminates. 

Let us define the quantities 

Ik = the length of the longest chain of faces in K, . 

& B (3.14) 

£ = min{£^: — 1, dimL}. 

We prove the correctness of our FRA and an upper bound on the number of reducing 
iterations in Theorem [TJ 

Theorem 1. Suppose that the FRA finds J/q, yi 3 • • • , and corresponding faces Fq, F±, . . . 
Then 

(1) F min C Fj for i = 0,1,... 

(2) After a sufficiently large number of reducing iterations the algorithm finds F m \ n = F t 
in some iteration t. Furthermore, 

F m i n — Fj 

holds for all i > t. 

(3) In particular, the number of reducing iterations in the FRA is at most i. 

Proof Let us first note that the face Fj found by the algorithm is of the form 

F = Kny^n---nyl-, i = 0,1,... 
Statement (P) follows from applying repeatedly part ([TJ of Lemma [TJ 
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Proof of ([2]) The first part of the claim is straightforward; in particular, the number 
of reducing iterations cannot exceed £k — 1- Suppose i > t. Since F t = F m - m , we have 



^mm c Fi = F t n yi + i n • • • n yf c F min , 

so equality holds throughout in (I3.15D . which proves Fi = F m \ n . 



(3.15) 



Proof of ([3]) Let us denote by k the number of reducing iterations. It remains to show 
that k < dim L holds, so assume to the contrary k > dim L. Suppose that , . . . , y\ h are 
the vectors found in reducing iterations. Since they are all in L, they must be linearly 
dependent, so there is an index r G {1, . . . , k} such that 

yi r elm{y il ,...,y ir _ 1 } C lin{y , yi, ■ ■ ■ , Vi r -l}- 

For brevity let us write s = i r . Then fl • • • Pi C yf, so 

F s = Fg-i, 

i.e., the s th step is not reducing, which is a contradiction. ■ 

Next we illustrate our algorithm on the examples of Section (2) 

Examples Q] and [2] continued Suppose we run our algorithm on the linear system 
(|2.8p . The yi vectors below, with corresponding faces shown, are a possible output: 



yo 
vi 

Vi 



0, F n 



(0, 0, 0, 1, 1) T , F x 



(I x {0} 2 , 
F min = R\ x {0} 4 . 



(3.16) 



(o, i, i, o, -iy,F 2 

The algorithm may also finish in one step, by finding, say, yo = 0, and 



Vi 



(0, 1, 1, 2, 1) 



(3.17) 



Of course, in linear systems there is always a reducing certificate that finds the minimal 
cone in one step, i.e., F m [ n — K n y^ for some y\ ^ 0; this is straightforward from LP 
duality. 

When we run our algorithm on the instance of (12.9H . the yi matrices below, with 
corresponding F{ faces, are a possible output: 



yo 

Vl 



in 




(3.18) 
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Indeed it is clear that the yi are orthogonal to all the constraint matrices in problem 
CUD and that y { G F*_ x for i = 1, 2. ■ 

Let us now consider the conic system 



2/0 = 

?/i G F*_ x , where 

Vi G L, i = l,...,£ 

that we call an extended system. 

We have the following representation theorem: 



Theorem 2. F^ in 



{yi+i I {VifiXl ^ feasible in \EXT\ }. 



{EXT) 



Before proving Theorem [2] we make some remarks. First, the two different ranges 
for the i indices in the constraints of (\EXT\i are not accidental: the sequence yo, . . . , ye 
is a possible output of our FRA, iff with some yi+i it is feasible in \EXT\ , and the 
variable ye+i represents the dual of the minimal cone. It also becomes clearer now why 
we allow nonreducing iterations in our algorithm: in the conic system <\EXT\ some yi 
correspond to reducing iterations, but others do not. 

The extended system <\EXT\) is not linear, due to how the y, t vectors depend on the 
previous yj, and in general we also don't know how to describe the duals of faces of 
K. Hence the representation of Theorem [2] is not yet immediately useful. However, in 
the next section we state an equivalent conic linear system to represent F*^ when K 
is nice, and arrive at the representation of (jl.ip . and at an extended dual of (fP|) , 



Proof of Theorem [2] Suppose that (j/j)i=o ^ s feasible in §EXT\i with corresponding 
faces Fq, . . . , Fg. By part ([T]) in Theorem [T] we have 

^min C F i} hence F* lhl D F e * . (3.19) 

Since ye+i G Ff in the set on the right hand side, the containment D follows. 

By part ([I])-© in Theorem Q] equality holds in ()3.19|) for at least one (yi)^ that 
is feasible in (\EXT\i and this proves the inclusion C . ■ 



4 When K is nice: an extended dual of (??) 

From now on we make the following assumption: 



K is nice. 
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Let us consider the conic system 

(EXT n 



(uo,v ) = (0,0) 

(ui,Vi) G K*xtan(u -\ h Ui-i, K*), % = 1, ...,£+ 1 

+ G L, i = 1, . . . ,£ 



This is a conic linear system, since the set 

{(u,v)\ue K*, v G tan(u,K*)} 

is a convex cone, although it may not be closed (e.g., if K* = R^_, then (e, 1) is in this 
set for all e > 0, but (0, 1) is not). 



Theorem 3. Feas fTEXTl) = { ( Ui + w^ft* : (u;,^)-± G Feas( |£XT nicc T ) }. 



Proof of C Suppose that (?/i)jio * s feasible in l\EXT\i . with faces 

= i<rn^n---n y -L 1 , * = i,...,* + i. (4.20) 

For i = 1, ...,£+ 1 we have G and if is nice, so we can write y% = Ui + Vi for 

some tij G -ftT* and -Uj G F^ v Also, let us set uq = vq = 0, then of course yo = uq + tjq. 



We show that (^i,Vj)iio ^ s feasible in <\EXT n \ c ^ . To do this, it is enough to verify 



= tan(u + ---+ Ui . u K*) (4.21) 
for i = 1, ...,£ + 1. Equation (I4.2ip will follow if we prove 

= Kn(n + --- + n i _ 1 ) ± (4.22) 
for i = 1, . . . , £ + 1; indeed, from (I4.22|) we directly obtain 

= face(tt H hUj-i,i^*) A , 

hence 

= face(xi + --- + «i-i,i ; s:*) A± 
= tan(u H 1- tii-i, i^*), 

where the second equality comes from f)2.2f) . 

So it remains to prove (|4.22p . It is clearly true for i = 1. Let i be a nonnegative 
integer at most £ + 1 and assume that (I4.22p holds for 1, . . . , i — 1. We then have 

Fi-i = F^nyin 

= Fj_ 2 n + Wi-i)- 1 

= if n (ii h h u^) 1 n uf_ x 

= Kn(u -\ h Ui-2 + Ui-i) -1 . 
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Here the second equation follows from the definition of Uj-i), the third from 

Vi-i G F t ^ 2 , the fourth from the inductive hypothesis, and the last from all Uj being in 
K* . 

Thus the proof of the containment C is complete. 



Proof of D Let us choose (ui, Wj)^ *° ^ e feasible in { EXT^ce ), define yi = Ui + V{ for 
all i, and the faces Fq, . . . , Fi as in (I4.20p . Repeating the previous argument verbatim, 
(|4.2ip holds, so we have 

y l eK* + F l ± _ 1 = F*_ 1 ,t = l,...,£ + l. 

Therefore (yi)jig ^ s feasible i n \EXT\i and this completes the proof. ■ 

We now arrive at the representation of F^ in that we previewed in (II. ip . and at an 
extended dual of (TF1): 



Corollary 1. The dual of the minimal cone of IF]) has a representation 

F mm = I ue+i + ve+i ■ {ui,Vi)j±o ^ feasible in < \EXT nicc \j }, (4.23) 
and the extended dual 

inf (b,U£ + i + V£ +1 ) 

S.t. A*(U£ + 1 + V£+i) = C (Dext) 

(nj,fj)^Q is feasible in <\EXT~\ 



has strong duality with IF]) . 



In particular, if IP}) is a semidefinite program with m variables, independent con- 
straint matrices, and K = <S", then the problem 

inf {b,u £+1 + v e+ i) 

s.t. A*(ue + i +v e+1 ) = c 

{A,b)*( Ui + Vi) = 0,i = l,...,£ 

m h 0, % = 1, ...,£ + 1 

/ \ I U ° + h W A v n ■ i o i i / n \ 

(*) T or >T 0,1 = 1,. ..,£+1 (Anrt.SDP) 

= + i = 1, . . . ,£ + 1 

Wi G R nxn ,i = l,...,£+1 

ft G R, i = 1, ...,£+ 1 

(uo,v ) = (0,0), 

£ = min{n, n(n + l)/2 - m - 1 }, (4.24) 
has strong duality with IP]) . 
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Proof The representation (|4.23p follows from combining Theorems [2] and El The 
second statement of the theorem follows, since replacing K* by in (f£>|) yields a 
strong dual for fPl) . 



Suppose now that (TPl) is a semidefinite program with K = 5?, with m variables, 
and with independent constraint matrices. The length of the longest chain of faces in 
5" is n + 1 and the dimension of the subspace N{{A, b)*) is n(n + l)/2 — m — 1. Hence 
we can choose £ as in (I4.24D to obtain a correct extended dual. 

Suppose that Vi G 5" is a symmetric matrix and uq, . . . , Ui-\ G <S+ are symmet- 
ric positive semidefinite matrices, where i G {1,...,£ + 1}. The representation of 
the tangent space in <S™ in (j2.7j) implies that Vi G tan(tio + ••• + Ui-%,K*) holds, 
iff Vi,uo, . . . ,1/4—1 with some Wi (possibly nonsymmetric) matrices and scalars satis- 
fies the ith constraint of (D cxt sdp I marked by (*). This proves the correctness of the 



extended dual (Dext.SDP)- 



For the reducing certificates found for the linear system (|2.8p and displayed in (|3,16p 
the reader can easily find the decomposition whose existence we showed in Theorem [3l 

Example [2] continued Recall that when we run our FRA on the SDP instance (12.9H . 
matrices yo> 2/1)2/2 shown in equation ()3.18|) are a possible output. 

We illustrate their decomposition as proved in Theorem [3j in particular, as = 
Ui + Vi with Uj £ K* and Vi G tan(iio + • • • + Ui-\, K *) for z = 1,2: 



u 



u 2 



0, 77 




0, 








/o 






















,vi = 0, 

















/o 









/o 


-1 





2 





,«2 = 








\o 





o) 




1-1 






(4.25) 



We can check V2 G tan(ni,5i) by using the tangent space formula (|2.6 



To illustrate the correctness of the extended dual (A;xt,SDp)) we first note that 
n = m = 3, so by formula (|4.24[) we can choose £ = 2 to obtain a correct extended dual. 
Recall that y G F^ in is an optimal dual solution if and only if 



/ 1/2 

1/2 2/22 
V-2/22/2 y 3 2 




>- 0. 



(4.26) 



Consider the (ui,Vi)f =0 sequence shown in (14.25j) : we prove that any y optimal matrix 
satisfies 

y G Sl + tan(u + u 1 + u 2 ,Sl). (4.27) 
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Indeed, tan(uo + u\ + U2,S+) is the set of 3 by 3 matrices with the component in the 
(1, 1) position equal to zero, and the other components arbitrary, and this proves (|4,27p . 

In fact, considering the expression for F^ in in ()2.10|) . it follows that any y G F^ in 
satisfies (l427|) . ■ 



5 Variants of the representation of F^ in and of extended 
duals 



So far we proved the correctness of an extended dual of (TP)) , which is itself an explicit 
semidefinite program when is. Ramana's original dual is somewhat different from 



(-Dcxt.SDp) though. Here we describe several variants of extended duals for ((£]) and 



show how to derive Ramana's dual. 

First let us define a simplified extended system 

(uo,v ) = (0,0) 

{ui,Vi) G K* x tan(iij_i, K*), i = 1, . . . ,£ + 1 /> (EXT nicc ^, uvlil i 

Ui + Vi G L, i = !,...,£. 



We prove that this system works just as well as (\EXT ni( ^ when constructing extended 
duals. 



Corollary 2. The dual of the minimal cone of fP\l has a representation 

F min = i u £+i + ^+i : (iH, v i)ito is feasible in <\EXT nicC)Simp i c ^ }, (5.28) 
and the extended dual 

inf {b,u e+1 + v i+1 ) 

s.t. A*(u i+1 + v t+ i) = c (D ext ) 



(ui, ViY^l is feasible in <\EXT nicC)Simp i c ^ 
where I is defined in ft3.14\ ), has strong duality with IF]) . 

In particular, if ( fF|) is an SDP as described in CorollaryU\ then the problem obtained 



from ( -D cx t, sdp ) by replacing the constraint (*) by 



(**) T « r ^ 0,i = l,...,£ + l, 



has strong duality with ( fP|) . 



Proof It is enough to prove the representation in equation (15. 28ft : given this, the rest 
of the proof is analogous to the proof the second and third statements in Corollary [TJ 
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We will use the representation of F^ in in (I4.23p . Let us denote by G the set on the 
right hand side of equation (|5.28P ; we will prove G = F^ in . 



To show G C F^ in suppose u i+ i+ve +1 € G, where (ui,V{)^ is feasible in (|-EXr niceiSim pi G p 



Then it is also feasible in ^EXT^^ , since applying the tangent space formula (j2.2j) with 
if* in place of if implies that 

tan(iij_i, if*) C tan(«o + ■ ■ ■ + itj-i, if *) 

holds for i = 1, ...,£+ 1. 

To prove G 3 F^ in suppose that U£fi + € -F mm , where (^j,fi)iid ^ s feasible 



in Qj^XTnice )■ Again, by (|2.2p the sets tan(ito, if*), • • • , tan(uo + • • • + if*) are all 
contained in tan(iio + • • • +Ui—\,K*) for i = Hence 



v\-\ \-Vi £ tan(-u H h itj_i, if*), i = l,...,£ 

holds, and we also have 



Let us define 



V£ + i £ tan(iio + • • • + ug, if* 



(u'^v'A = (u H hnj,f H \- Vi), i = 1, . . . ,£. 



(5.29) 
(5.30) 



By (15.291) and (I5.30P it follows that (ug + i,ve+i) with {u[, v[) i= Q is feasible for (EXT n i cetS i mp \ e ) , 
so the inclusion follows. ■ 



Let us now consider another extended system 

,simpW 

where the set tan'(ii, if*), satisfies the following two requirements for all u € if* : 



(u ,v ) = (0,0) 

(ui,Vi) G if* x tan' (v,i-x,K*), i = 1, ...,£ + 1 }, 
Ui + Vi e L,i = !,...,£ 



(1) tari(u,K*) C tan(«,if*). 

(2) For all u E tan(u, if*) there exists X v > such that t> 6 tan'(A„u, if*) 
Corollary 3. The dual of the minimal cone of IP]) /ias the representation 

= { u e+1 + v e+ i : (ui, Vif^l is feasible in \EXT l a . ccs - I ~^ }, 



F*. 



(5.31) 



and the extended dual 



inf (b,u e+1 + v e+1 ) 

s.t. A*(u i+1 + v i+ i) = c 



ext, simple/ 



' 1 is feasible in <\EXT nice ^^ ( 



where £ is defined in \3.1J$ , has strong duality with {P 
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In particular, if ( fPj) is an SDP as described in CorollaryUl then the problem obtained 



from (-D e xt,SDp) by replacing the constraint (*) by 



(***) J j J hO,i = h...,£ + l, 



and dropping the variables, has strong duality with $F 



Proof We use the representation of F^ in in (|5.28p . Let us denote by G the set on the 
right hand side of equation (I5.31f) . We will prove G = F^ in . 

It is clear that G C F^ in , since if (u^Vi)^ is feasible in (EXJ^^^), then by 
the first property of the operator tan' it is also feasible in ( j^'A'_/ n i CCiS i mp i e p . 

To show the opposite inclusion, suppose ue + i + V£ + i £ -F min , where («j,fj)iio ^ s 
feasible in (EXT n i ce>s i mp i e ). Let us choose , A^_i, . . . , Ai positive reals such that 

v t+1 € tan'(A^«^,iC*), 

(5.32) 



X2V2 € tan'(Aini, i^*), 



and for completeness, set Ao = 0. Then (ue + i,V£ + i) with (XiUi, XiVi) e i=0 is feasible in 
\EXT^ icc simple \ , and this proves F* in C G. ' ■ 

We finally remark that in the extended duals for semidefinite programming it is 
possible to eliminate the Vi variables and use the Wi matrices directly in the constraints; 
thus one can exactly obtain Ramana's dual. We leave the details to the reader. 



6 Conclusion 

We gave a self-contained exposition of a facial reduction algorithm and of extended duals: 
both approaches yield strong duality for a conic linear program, without assuming any 
constraint qualification. Using ideas from [26] we proved that when K is a nice cone, 
the set F^ in has an extended formulation, i.e., it can be written as the projection of the 
feasible set of a conic linear system in a higher dimensional space. The only nontrivial 
constraints in this system are of the form u >k* 0, and v £ tan(n, K*). 

This formulation leads to an extended, strong dual of (??); and when K = K* is the 
semidefinite cone, by writing the tangent space constraint as a semidefinite constraint, 
we obtain an extended strong dual, which is an SDP itself. 

One may wonder, whether there is 3-D. extended formulation for -Fmin 

itself. Suppose 

that K is an arbitary closed convex cone. When a fixed s G r\F m ^ is given, then 
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obviously 

Fmin = { s | <k s <k as for some a > }. 
The minimal cone can also be represented without such an s, since 

-Fmin = { s I <k s <k ctb — Ax for some x, and a > }. (6.33) 

This representation was obtained by Freund [12], based on the article by himself, Roundy 
and Todd [T3]. 

It is also natural to ask, whether there are other nice cones, for which the set 

{ (u, v) | u G K*, v G tan(tt, K*) } 

has a formulation in terms of K*; e.g., is this true for the second order cone? Conic 
linear programs over such cones would also have Ramana-type (ie. expressed only in 
terms of K*) extended duals. 

Acknowledgement Thanks are due to an anonymous referee for his/her helpful com- 
ments on an earlier version of the paper. 
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